System and method for inserting a graphic object into a text based message

ABSTRACT

A system and method for selecting graphic objects to insert in a text message when composed on a wireless device, each of the graphic objects representing a set of individual alphanumeric characters. The system comprises an object table for display on a user interface of the device, such that the table is configured for including a first object of the graphic objects associated with a first predefined input and a second object of the graphic objects associated with a second predefined input. The first input is different from the second input. The system also has a first input event component for coupling to the user interface such that the first input event component is configured for mapping to the first predefined input. The system also has a second input event component for coupling to the user interface such that the second input event component is configured for mapping to the second predefined input, the first input event component being different from the second input event component. A user of the device selects one of the graphic objects from the table by employing the respective one of the input event components mapped to the predefined input associated with the graphic object in the table.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 10/935,620,filed on Sep. 8, 2004, now U.S. Pat. No. 8,281,239, the entiredisclosure of which is hereby incorporated by reference for allpurposes.

BACKGROUND

With the increasing popularity of instant messaging, as well as email,users continue to develop shortcuts for conveying words, phrases, andemotions to make these text-based communications more efficient andfluent. These shortcuts may include the insertion of acronyms,abbreviations, symbols, or combinations thereof in to the text messages.Given the difficulty in communicating emotion with writtencommunications, a growing set of accepted symbols for emotions oftenpunctuates these text-based messages. For example, a :-) or :-( caneasily convey whether a sender of a message is happy or sad,respectively.

However, reduced sizes and varying complexities of keyboards for mobilecommunication devices typically involves the use of additional symboltables and other data input means that are different from standardQUERTY keyboards for desktop environments. These keyboard differences aswell as the effects of miniaturization can make the required inputsequence for emoticons time consuming and inconvenient for a majority ofthe emoticons used in commonly used text messaging applications.

Accordingly, it is an object of the present invention to provide agraphic object insertion system and method to obviate or mitigate atleast some of the above presented disadvantages.

SUMMARY OF THE INVENTION

Reduced sizes and varying complexities of keyboards for mobilecommunication devices typically involves the use of additional symboltables and other data input means that are different from standardQUERTY keyboards for desktop environments. These keyboard differences aswell as the effects of miniaturization can make the required inputsequence for emoticons time consuming and inconvenient for a majority ofthe emoticons used in commonly used text messaging applications.Contrary to present graphic object insertion methods, there is providedherein a system and method for selecting graphic objects to insert in atext message when composed on a wireless device, each of the graphicobjects representing a set of individual alphanumeric characters. Thesystem comprises an object table for display on a user interface of thedevice, such that the table is configured for including a first objectof the graphic objects associated with a first predefined input and asecond object of the graphic objects associated with a second predefinedinput. The first input is different from the second input. The systemalso has a first input event component for coupling to the userinterface such that the first input event component is configured formapping to the first predefined input. The system also has a secondinput event component for coupling to the user interface such that thesecond input event component is configured for mapping to the secondpredefined input, the first input event component being different fromthe second input event component. A user of the device selects one ofthe graphic objects from the table by employing the respective one ofthe input event components mapped to the predefined input associatedwith the graphic object in the table.

There is provided herein a system for selecting graphic objects toinsert in a text message when composed on a wireless device, each of thegraphic objects representing a set of individual alphanumericcharacters, the system comprising: a object table for display on a userinterface of the device, the table configured for including a firstobject of the graphic objects associated with a first predefined inputand a second object of the graphic objects associated with a secondpredefined input, the first input different from the second input; afirst input event component for coupling to the user interface, thefirst input event component configured for mapping to the firstpredefined input; and a second input event component for coupling to theuser interface, the second input event component configured for mappingto the second predefined input, the first input event componentdifferent from the second input event component; wherein a user of thedevice selects one of the graphic objects from the table by employingthe respective one of the input event components mapped to thepredefined input associated with the graphic object in the table.

Also disclosed there is provided a method for selecting graphic objectsto insert in a text message when composed on a wireless device, each ofthe graphic objects representing a set of individual alphanumericcharacters, the method comprising the steps of: displaying an objecttable on a user interface of the device, the table configured forincluding a first object of the graphic objects associated with a firstpredefined input and a second object of the graphic objects associatedwith a second predefined input, the first input different from thesecond input; employing one of a first input event and a second inputevent for selecting the desired graphic object from the first and secondobjects, the first input event configured for mapping to the firstpredefined input and the second input event configured for mapping tothe second predefined input, the first input event different from thesecond input event; and inserting the selected graphic object in to thetext message.

Also disclosed there is provided a computer program product forselecting graphic objects to insert in a text message when composed on awireless device, each of the graphic objects representing a set ofindividual alphanumeric characters, the computer program productcomprising: a computer readable medium; a object table module stored onthe medium for display on a user interface of the device, the tablemodule configured for including a first object of the graphic objectsassociated with a first predefined input and a second object of thegraphic objects associated with a second predefined input, the firstinput different from the second input; a first input event module storedon the medium for coupling to the user interface, the first input eventmodule configured for mapping to the first predefined input; and asecond input event module stored on the medium for coupling to the userinterface, the second input event module configured for mapping to thesecond predefined input, the first input event module different from thesecond input event module; wherein a user of the device selects one ofthe graphic objects from the table by employing the respective one ofthe input event modules mapped to the predefined input associated withthe graphic object in the table.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features will become more apparent in the followingdetailed description in which reference is made to the appended drawingswherein:

FIG. 1 is a block diagram of a network messaging system;

FIG. 2 is a block diagram of a mobile communication device of FIG. 1;

FIG. 3 is an example user interface of the device of FIG. 2;

FIG. 4 is an object table for display on the user interface of FIG. 3;

FIG. 5 is further embodiment of the object table of FIG. 4;

FIG. 6 shows further example emoticons of the table of FIG. 4;

FIG. 7 diagram of an example messaging environment of the system of FIG.1;

FIG. 8 is further embodiment of a keyboard of FIG. 3;

FIG. 9 is a block diagram of a further example of the mobilecommunication device of FIG. 2; and

FIG. 10 is a flowchart of the operation of the object table of FIG. 4.

DESCRIPTION

Network System

Referring to FIG. 1, a communication network 10 comprises mobilecommunication devices 100 for interacting with one another via a network101, which can contain a wireless network 102 and the Internet 104. Thewireless network 102 supports the transmission of data in networkmessages 105 between the devices 100 and external systems 12, which arecoupled to the wireless network 102. The wireless network 102 may alsosupport voice communication for telephone calls between the mobilecommunication devices 100 and devices which are external to the wirelessnetwork 102. A wireless data transmission protocol can be used by thewireless network 102, such as but not limited to DataTAC, GPRS or CDMA.The mobile devices 100 transmit and receive the messages 105, such astext and/or voice based messages 105, when in communication with oneanother via a server. For text based messages 105, the server can besuch as but not limited to an email server 106, a Short Message Service(SMS) server 108, or an Instant Messaging (IM) server 110. It isrecognized that the external systems 12 can include desktop computers(i.e. wired devices) 112 coupled to the network 101 via a LAN 114.

The mobile devices 100 can communicate with one another as clients ofthe servers 106, 108, 110 using the messages 105 in the form of messageheader information and associated data content, for example whenexchanging personal messages 105. The format of the personal messages105 communicated between the devices 100 is moderated by a mutualcontract (as is known in the art) embodied in the application programs302 (see FIG. 2), which are executed on the devices 100. The mutualcontract facilitates standardized communication between the devices 100of Emoticons and other graphics based objects/icons included in the datacontent of the messages 105. It is recognized that the mobile devices100 can communicate with one or more servers 106, 108, 110 via thewireless network 101. It is also recognized that the functionality ofthe servers 106,108,110 could be as shown or combined in to one or moregeneric servers coupled to the network 101, if desired.

Client Device

Referring to FIG. 2, the mobile communication devices 100 are devicessuch as but not limited to mobile telephones, PDAs, two-way pagers anddual-mode communication devices 710 (see FIG. 9). The mobile devices 100include a wireless transceiver 200 coupled via connection 218 to adevice infrastructure 204. The wireless transceiver 200 is connectableduring operation of the mobile devices 100 to the wireless network 102by a suitable wireless channel such as RF or IR links, which enables themobile devices 100 to communicate with each other and with externalsystems (such as the servers 106,108,110) via the network 101, and tocoordinate the messages 105 between the client application programs 302via the servers 106, 108, 110 (see FIG. 1).

Referring again to FIG. 2, the mobile devices 100 also have a userinterface 202, coupled to the device infrastructure 204 by connection222, to interact with a user (not shown). The user interface 202includes one or more user input devices such as but not limited to aQWERTY keyboard, a keypad, a trackwheel, a stylus, and a user outputdevice such as an LCD screen display. If the screen is touch sensitive,then the display can also be used as the user input device as controlledby the device infrastructure 204. The user interface 202 is employed bythe user of the mobile device 100 to coordinate the exchange of messages105 over the network 10 (see FIG. 1) as employed by client applicationprograms 302.

Referring again to FIG. 2, operation of the mobile communication device100 is enabled by the device infrastructure 204. The deviceinfrastructure 204 includes a computer processor 208 and associatedmemory module 210. The computer processor 208 manipulates the operationof the wireless transceiver 200, the user interface 202 and a runtimeenvironment 206 of the mobile communication device 100 by executingrelated instructions, which are provided by an operating system andclient application programs 302 provisioned in the runtime environment206. Further, it is recognized that the device infrastructure 204 caninclude a computer readable storage medium 212 coupled to the processor208 for providing instructions to the processor 208 and/or toload/update client application programs 302 in the memory module 210.The computer readable medium 212 can include hardware and/or softwaresuch as, by way of example only, magnetic disks, magnetic tape,optically readable medium such as CD/DVD ROMS, and memory cards. In eachcase, the computer readable medium 212 may take the form of a smalldisk, floppy diskette, cassette, hard disk drive, solid state memorycard, or RAM provided in the memory module 210. It should be noted thatthe above listed example computer readable mediums 212 can be usedeither alone or in combination.

Referring again to FIG. 2, the runtime environment 206 of the mobiledevice 100 is coupled to the device infrastructure 204 by connection220. The runtime environment 206 provides a native runtime environmentfor the client application programs 302 and is an interface to themobile device 100 functionality of the processor 208 and associatedoperating system of the device infrastructure 204. The runtimeenvironment 206 preferably supplies a controlled, secure and stableenvironment on the mobile device 100, in which the component applicationprograms 302 are provisioned and executed. The runtime environment 206and/or the application programs 302 also provide services 304 (such asbut not limited to Communications, Screen, Data Persistence, andSecurity). The client runtime environment 206 is preferably capable ofgenerating, hosting and executing the client application programs 302.Further, specific functions of the runtime environment 206 can includesupport for language, coordinating memory allocation, networking,management of data during I/O operations, coordinating graphics on theoutput device of the user interface 202 via the device infrastructure204 and providing access to core object oriented classes and supportingfiles/libraries. Examples of the runtime environments 206 can includesuch as but not limited to Common Language Runtime (CLR) by Microsoftand Java Runtime Environment (JRE) by Sun Microsystems. The runtimeenvironment 206 supports basic functions for the client applicationprograms 302 on the mobile device 100, such as but not limited to:provide a communications service 304 capability to send the messages 105over the network 101 (see FIG. 1); provide data input service 304capabilities by the user on the input device to supply data content foroutgoing messages 105 (see FIG. 1); provide data presentation or outputservice 304 capabilities for incoming messages 105; and provide datastorage services 304 to maintain local client data in the memory module210.

In general, the services 304 coordinate communications via theconnection 220 with the device infrastructure 204. For example, thecommunication service 304 manages connectivity between the componentapplication programs 302 and the network 101. Messages 105 are sent tothe appropriate server 106,108,110 by the communication service 304 onbehalf of the component applications 302. The communication service 304also receives data of the messages 105 from the server 106,108,110 anddelivers the data to the component applications 302. Data received bythe communication service 304 can include synchronous responses torequests made by the component application programs 302 and asynchronousdata pushed to the mobile communication device 100 by the server106,108,110. The communication service 304 also manages connectivitywhen the mobile communication device 100 is disconnected from thenetwork 101. When the mobile communication device 100 is in disconnectedmode, messages sent by the component applications 302 can be queued bythe communication service 304, and sent once the mobile communicationdevice 100 is reconnected to the network 102.

Referring again to FIG. 2, the screen service 304 manages the visualrepresentation of the component application programs 302 as they aredisplayed on the output device of the user interface 202. The visualrepresentation can include images such as Emoticons and other graphicsbased objects/icons 402 (see FIG. 4), graphical user interface (GUI)controls and windows, and text. The screen service 304 can manage ascreen stack, which controls what the user sees on the output device ofthe device infrastructure 204. Further, the persistence service 304allows the component application programs 302 to store data in thememory module 210 of the device infrastructure 204. Database operationscan be provided by the persistence service 304 in a transparent fashionto the component application programs 302.

Communication Servers

Referring again to FIG. 1, the IM server 110 enables short text messages105 to be exchanged between the devices 100, whereby a user of thedevice 100 uses the user interface 202 for inputting the message 105using (for example) keys 306 of a keypad 300 (see FIG. 3), such that thecomposed message 105 is exchanged over the network 101 via the IM server110. The keypad 300 (or other input event component means) and thedisplay 308 (of the user interface 202) enable the user to,respectively, input the message 105 or associated command data anddisplay the inputted or received message 105 or associated command data.The user may enter text via the user interface 202 by holding the device100 in two hands and performing a “thumb typing;” or other two-finger“poke typing” technique on the keypad 300.

The IM server 108 allows users of the devices 100 to form a list ofpeople with whom they wish to communicate. This list is typically calleda “buddy list,” and the IM server 110 facilitates users to communicatewith anyone on their buddy list, assuming that the person is on-line atthat given time. Generally, users of the device 100 will send an alertto those persons on their buddy list who are on-line (connected via thenetwork 101) prior to engaging in a conversation via the messages 105.IM server 110 services provide a small text window on the display 308(see FIG. 3) of the device 100, where two or more users can typemessages that both users can instantly view on the displays 308 of theirrespective devices 100. IM messages 105 are typically short, abbreviatedstrings of text capable of conveying a certain meaning, and preferablyassociated with characteristics of the sender of the message 105. Thesecharacteristics relate to the emotional state or personality of thesender, as well as any particular emphasis associated with a givenmessage. Thus, an aspect of IM is the ability to effectively communicatethese characteristics via graphics based objects/icons such asEmoticons. Examples of IM servers 110 include such as but not limited toMicrosoft Messenger, AOL Instant Messenger, Yahoo Messenger and ICQ.

Referring again to FIG. 1, the SMS server 108 also enables short textmessages 105 to be exchanged between the devices 100, whereby a user ofthe device 100 inputs the message 105 using keys 306 of the keypad 300(see FIG. 3) for transmission over the network 101 via the SMS server108. Similar to IM messages 105, SMS messages 105 are also typicallyshort, abbreviated strings of text capable of conveying a certainmeaning, and preferably associated with characteristics of the sender ofthe message 105. The SMS server 108 and associated application programs302 on the devices 100 can accommodate the use of Emoticons and othergraphics based objects/icons 402 (see FIG. 4) as well as abbreviations,as further described below. It is recognized that email usage betweenthe devices 100 via the email server 106 also increasingly employsEmoticons, abbreviations, and other graphics based objects/icons as datacontent for the email messages 105.

Message Content

The increasing usage of text messaging (such as but not limited to IM,SMS and email) has led to a greater popularity in Emoticon use.Emoticons are pictures built out of for example ASCII characters, oftensideways, used in human-to-human electronic communications, such ase-mail, chat, and IRC. The use of emoticons is intended to compensatefor the lack of evocative, emotional content in the text of the messages105. Abbreviations are another form of alphanumeric character sequencesexpressed as a graphic object in text messages 105, and are used as akeystroke saving measure by the users of the devices 100. Device userscommonly insert emoticons and other graphics based objects/icons 402(alphanumeric based) in their messages 105 (via the keyboard 300—seeFIG. 3) as a sequence of typed characters that creates a rough pictureof something, such as a facial expression. For example the typedsequence “:”, “-”, “)” is such that the colon represents the eyes, thedash represents the nose, and the right parenthesis represents themouth, hence :-). More commonly known as “smileys” and also referred toas “ASCII-grams,” emoticons number in the hundreds and are used toindicate emotions such as delight, sadness, or frustration. The mostpopular emoticon is the above noted smiling face, which people use ine-mail or chat rooms to say, “If you could see me now, I'd be smiling.”It is recognized that representation of the alphanumeric charactersequences on the display 308 (see FIG. 3) of the device 100 can be thatof the raw alphanumeric character sequence or as a graphical iconrepresenting the character sequence. For convenience, Emoticons andother alphanumeric based character sets (including abbreviations) willhereafter be referred to as alphanumeric based graphic objects 402,which represent a set or group of alphanumeric characters that are in apredefined order.

The term “emoticon” can be defined as “an icon that represents emotion.”Emoticons are one type of graphical objects 402 that grew out of theneed to display feeling in the two-dimensional, online, written world ofmessages 105. When speaking face-to-face (F2F), a person's facialexpressions help you understand the meaning of what he or she is saying.Emoticons are an attempt to bring that extra nuance to onlinecommunications of the devices 100 by composing a face out ofalphanumeric characters. Some emoticons don't require you to tilt yourhead to see them. There's a new group of ASCII icons called assicons, aswell as another group, called straight-on smileys. There are alsoelaborate images, known as ASCII art. These are generally used in sigfiles. Emoticons usually follow after the punctuation (or replace thepunctuation) at the end of a sentence. An emoticon tells someone whatyou really mean when you make an offhand remark ;^) Examples ofgraphical objects 402 as emoticons are:

:-)—Happy

:-(—Sad

:-o—Surprised

:-@—Screaming

:-I—Indifferent

:-e—Disappointed

>:-<—Mad

:-D—Laughing

;-)—Wink

It is recognized that emoticons can be broadly defined to include otheralphanumeric character sequences including abbreviations as graphicalobjects 402, such as:

<BFN> Bye For Now

<BTW> By The Way

<G> Grin

<HTH> Hope This Helps

<IJWTK> I Just Want To Know

<IJWTS> I Just Want To Say

<IMHO> In My Humble Opinion

<LOL> Laughing Out Loud

<OTOH> On The Other Hand

<ROTFL> Rolling on the Floor Laughing

<TOY> Thinking of You

<YMMV> Your Mileage May Vary

as well as other non-emotional alphanumeric based objects 402 (e.g.flower (F), cat (@) and gift (G)). Examples of equivalent graphicalobjects 402 (e.g. icons) of corresponding alphanumeric based charactersequences are shown in FIG. 6.

It is recognized that the alphanumeric character sets can be based onsuch as but not limited to ASCII characters and Unicode characters.Unicode characters are a set of codes used to represent letters,numbers, control characters, and the like, designed for useinternationally in computers. Adopted as an international standard in1992, it is intended to replace ASCII as the primary alphanumericcharacter set. Unicode is a “double-byte,” or 16-digit, binary number(see numeration) code that can represent up to 65,536 items. The Unicodestandard defines codes for letters, special characters, and otherlinguistic symbols used in every major language written today. Itincludes the Latin alphabet used for English, the Cyrillic alphabet usedfor Russian, the Greek, Hebrew, and Arabic alphabets, and otheralphabets and alphabet like writing systems used in countries acrossEurope, Africa, the Indian subcontinent, and Asia, such as Japanesekana, Korean hangeul, and Chinese bopomofo. The largest part of theUnicode standard is devoted to thousands of unified character codes forChinese, Japanese, and Korean ideographs.

Graphical Object Input and Transmission

Nowadays, the emoticons and other alphanumeric based character sets aretypically displayed on the user interface 202 (see FIG. 2) as graphicalicons/objects 402 in graphics enabled UI environments. Referring to FIG.7, an example network 10 is shown for an IM message environment by wayof example only, wherein an IM sender device 100 a transmits IM messages105 to an IM recipient device 100 b via the network 101 and associatedIM server 110. Based on the standardized format of the mutual contract,each application 302 of the devices 100 a,b has access to a similarsymbol table 410 (see FIG. 4) containing a plurality of Emoticons andother alphanumeric based graphical objects 402 and their associatedpredefined inputs 403, as provided. Each of the objects 402 in the table410 is associated or otherwise mapped to the predefined input 403 alsoillustrated in the table 410, which is mapped to such as but not limitedto specific predefined keys 306 of the keypad 300, as shown on thedisplay 308 (see FIG. 3). It is also recognized that the predefinedinput 403 could be a label (e.g. “smile”) that could be used for voiceactivated command inputs to the UI 202. It is recognized thatrepresentations of the plurality of objects 402 are not printed next tothe keys 306 of the physical keypad 300, rather are only displayed onthe display 308 in association with the inputs 403 provided in thedisplayed symbol table 410. Hence a representation (predefined input514) of the “Y” key 314 (i.e. user input event component) is displayedin the symbol table 410 in association with a corresponding smile object414, see FIG. 4.

The runtime environment 206 can also have an object translation module404, which coordinates a translation between the representativealphanumeric character set and the corresponding graphical object 402where required. For example, the messages 105 when transmitted over thenetwork 101 typically contain data content such that the objects 402 arerepresented in the transmitted data stream as alphanumeric characters.Depending upon the UI 202 capabilities of the devices 100 a,b, theobjects 402 can be inputted and/or displayed as the series of individualalphanumeric characters or as the corresponding graphic object 402selected from the symbol table 410 (see FIG. 4). The module 404 of thesender device 100 a converts any objects 402 in the composed message 105to the corresponding set of individual alphanumeric characters prior totransmission of the composed message 105. In turn, the module 404 of therecipient device 100 b converts the individual alphanumeric charactersinto the appropriate graphical object 402 for display on the userinterface 202.

It is recognized that the services 304 are involved in composing,transmitting/receiving and displaying the objects 402 of the messages105. For example, the messages 105 with contained objects 402 aresent/received with respect to the appropriate server 106,108,110 by thecommunication service 304 on behalf of the component applications 302.The screen service 304 manages the visual representation of the messages105 and contained objects 402 as they are displayed on the output deviceof the user interface 202. Further, the persistence service 304 allowsthe component application programs 302 to access the objects 402 of thesymbol table 410, in response to input events by the user on the userinterface 202, from the memory module 210 of the device infrastructure204. It is recognized that the services 304 could be part of theapplication 302 or separate, as desired. As well, the module 404 couldbe separate from the application 302, included in the application,and/or associated with the services 304 according to the capabilities ofthe runtime 206 and design of the applications 302.

Referring to FIG. 3, a symbol key 310 (or other input event component ofthe UI 202) when activated by the user causes the screen service 304(see FIG. 2) to display an initial symbol table 400 on the display 308containing individual alphanumeric characters not available asselections on the physical keypad 300. It is recognized that the key 310or other input event (such as but not limited to voice activation and atouch sensitive display) can be used from the UI 202 (see FIG. 2) tocause the table 400 to be displayed on the display 308. Displayed in thesymbol table 400 is a table selection 406 mapped to the appropriateinput event of the UI 202, for example the symbol key 310 of the keypad300. The selection 406 has an associated indicator 408 for indicatingthat the selection 406 is associated with the plurality of graphicalobjects 402 (see FIG. 4) of the primary object symbol table 410. Whenselected by the user, the selection 406 causes the screen service 304 toreplace the table 400 with the primary object symbol table 410, as isshown in FIG. 4. It is recognized that the primary object symbol table410 can also include the selection 406 and associated indicator 408 tocause replacement of the primary table 410 with a secondary table 412(see FIG. 5) containing further object 402 selections. It is recognizedthat a number of object symbol tables 410, 412 can be sequenced in thismanner on the display 308, as dictated by the number of availableobjects 402 for selection by the user of the device 100.

It is recognized that FIGS. 3, 4, 5 show the use of the same selectionkey 406 to access the initial table 400 as well as the additional objecttables 410,412, i.e. the “SYM” key 310. In this manner, preferablyoperation of the same input event (e.g. key 310) twice in relativelyquick succession causes the primary table 410 (three times for thesecondary table 412, etc. . . . ) to be displayed through a limitednumber of input events done by the user via the user interface 202, sothat the user can straightforwardly display the available object 402selections on the display 308. However, it is also recognized that theinput events (e.g. keys 306 of the keypad 300) can be different for thevarious tables 410, 412. Accordingly, the indicator 408 can beassociated with the same (or different) input events (e.g. the SYM key310 for the table 410 and the trackwheel for the table 412) for eachrespective table 410, 412, as desired.

Referring to FIG. 4, once the appropriate object symbol table 410, 412is displayed on the display 308, the user can use the predefined input403 associated with the object 402 to choose the appropriate input eventto select and then accordingly insert the selected object 402 from thetable 410, 412 into the composed message 105. It is recognized that thesymbol table 410, 412 as displayed on the display 308 contains each ofthe objects 402 (representing a sequence of individual alphanumericcharacters) associated with the predefined input 403 as well as anillustration of the predefined input 403. Each of the displayedpredefined inputs 403 in the table is mapped to a specified user event(e.g. key 306). For example, a “Y” key 314 (i.e. input event) isdisplayed as the predefined input 514 in the symbol table 410 inassociation with a corresponding smile object 414. For example,referring to FIGS. 3 and 4, the input events 1) push key 310 (inputevent) once to display the table 400, 2) push key 310 (input event) asecond time to display the table 410, and 3) push the associated “Y” key314 (input event) once as displayed in the table 410 as the predefinedinput 514 causes the application 302 to retrieve the specific “smile”object 414 from the memory 210 (see FIG. 2), which is subsequently inputinto the message 105 as composed by the user. It should be recognizedthat the user in the above example uses three coordinated input eventsto select one specific graphical object 402 (i.e. smile object 414)representing the sequence of three individual alphanumeric characters“:”, “-”, “)”. Further, it is recognized that the object 402 could bedepicted in the table 410 and also displayed on the display 308 as thesequence of alphanumeric characters, i.e. “:-)”, depending upon thecapabilities of the application 302 and/or device 100 and/or preferenceof the user. Accordingly, the use of the specified input events (e.g.key 310 with specific key 314) can facilitate the access and use fromthe table 410,412 of a plurality of the objects 402 by the user in acoordinated fashion.

Referring to FIGS. 3 and 8, it is recognized that a keypad 300 a can beconfigured to contain certain individual alphanumeric characters of theobjects 402 (see FIG. 4) associated with the keys 306. For example, thespecific “Y” key 314 has an associated “)” symbol, hence the smileobject 414 (representative of :-)) is associated (via the displayedpredefined input 514) with the input event key 314 such that the inputevent sequence: key 310—key 310—key 314 produces the object 414 on thedisplay 308. Another example of configuring the keyboard keys 306 is the“P” key 316 (associated with the displayed predefined input 516) for theinput event sequence: key 310—key 310—key 316 producing the object 416on the display 308 (representative of :-P).

In operation 900 of the system 10, referring to FIGS. 3, 4 and 10, theuser selects 902 a first input event (e.g. key 310) to display thesymbol table 400 on the display 308 containing a plurality of individualalphanumeric characters. The user then selects 904 a second input event(e.g. key 310) where needed to display the object table 410 containingthe objects 402 for selection by the user, such that the table 410contains each object 402 (e.g. smile object 414) associated with apredefined input 403 (e.g. “Y” key 514), which is mapped to a thirdinput event (e.g. “Y” key 306). The user then selects 906 the thirdinput event to select the corresponding object 402 from the table 410for insertion 908 in to the composed message 105 (see FIG. 1). It isrecognized that the first input event may directly display the table 410containing the objects 402 and corresponding predefined inputs 403 (i.e.a two user event sequence to insert the object 402 in the message 105).Further, it is recognized that further user events could be used todisplay the additional tables 412 before selection of the object 402.

FIG. 9 is a block diagram of a dual-mode mobile communication device710, which is a further example of the UI 202 and infrastructure 204 ofthe device 100 of FIGS. 1 and 2. The dual-mode mobile communicationdevice 710 includes a transceiver 711, a microprocessor 738, a display722, Flash memory 724, RAM memory 726, auxiliary input/output (I/O)devices 728, a serial port 730, a keyboard 732, a speaker 734, amicrophone 736, a short-range wireless communications sub-system 740,and may also include other device sub-systems 742. The transceiver 711preferably includes transmit and receive antennas 716, 718, a receiver712, a transmitter 714, one or more local oscillators 713, and a digitalsignal processor 720. Within the Flash memory 724, the dual-mode mobilecommunication device 710 preferably includes a plurality of softwaremodules 724A-724N that can be executed by the microprocessor 738 (and/orthe DSP 720), including a voice communication module 724A, a datacommunication module 724B, and a plurality of other operational modules724N for carrying out a plurality of other functions.

The dual-mode mobile communication device 710 is preferably a two-waycommunication device having voice and data communication capabilities.Thus, for example, the dual-mode mobile communication device 710 maycommunicate over a voice network, such as any of the analog or digitalcellular networks, and may also communicate over a data network. Thevoice and data networks are depicted in FIG. 9 by the communicationtower 719. These voice and data networks may be separate communicationnetworks using separate infrastructure, such as base stations, networkcontrollers, etc., or they may be integrated into a single wirelessnetwork.

The communication subsystem 711 is used to communicate with the voiceand data network 719, and includes the receiver 712, the transmitter714, the one or more local oscillators 713 and may also include the DSP720. The DSP 720 is used to send and receive signals to and from thetransmitter 714 and receiver 712, and is also utilized to receivecontrol information from the transmitter 714 and to provide controlinformation to the receiver 712. If the voice and data communicationsoccur at a single frequency, or closely-spaced set of frequencies, thena single local oscillator 713 may be used in conjunction with thetransmitter 714 and receiver 712. Alternatively, if differentfrequencies are utilized for voice communications versus datacommunications, then a plurality of local oscillators 713 can be used togenerate a plurality of frequencies corresponding to the voice and datanetworks 719. Although two antennas 716, 718 are depicted in FIG. 9, thedual-mode mobile communication device 710 could be used with a singleantenna structure. Information, which includes both voice and datainformation, is communicated to and from the communication module 711via a link between the DSP 720 and the microprocessor 738. The detaileddesign of the communication subsystem 711, such as frequency band,component selection, power level, etc., is dependent upon thecommunication network 719 in which the dual-mode mobile communicationdevice 710 is intended to operate. For example, a dual-mode mobilecommunication device 710 intended to operate in a North American marketmay include a communication subsystem 711 designed to operate with theMobitex™ or DataTAC™ mobile data communication networks and alsodesigned to operated with any of a variety of voice communicationnetworks, such as AMPS, TDMA, CDMA, PCS, etc., whereas a device 710intended for use in Europe may be configured to operate with the GeneralPacket Radio Service (GPRS) data communication network and the GSM voicecommunication network. Other types of data and voice networks, bothseparate and integrated, may also be utilized with the dual-mode mobilecommunication device 710.

Depending upon the type of network or networks 719, the accessrequirements for the dual-mode mobile communication device 710 may alsovary. For example, in the Mobitex and DataTAC data networks, mobiledevices are registered on the network using a unique identificationnumber associated with each device. In GPRS data networks, however,network access is associated with a subscriber or user of a mobiledevice. A GPRS device typically requires a subscriber identity module(“SIM”), which is required in order to operate a dual-mode mobilecommunication device on a GPRS network. Local or non-networkcommunication functions (if any) may be operable, without the SIM, but adual-mode mobile communication device will be unable to carry out anyfunctions involving communications over the data network 719, other thanany legally required operations, such as 911 emergency calling.

After any required network registration or activation procedures havebeen completed, the dual-mode mobile communication device 710 may thensend and receive communication signals, including both voice and datasignals, over the network 719 (or networks). Signals received by theantenna 716 from the communication network 719 are routed to thereceiver 712, which provides for signal amplification, frequency downconversion, filtering, channel selection, etc., and may also provideanalog to digital conversion. Analog to digital conversion of thereceived signal allows more complex communication functions, such asdigital demodulation and decoding to be performed using the DSP 720. Ina similar manner, signals to be transmitted to the network 719 areprocessed, including modulation and encoding, for example, by the DSP720 and are then provided to the transmitter 714 for digital to analogconversion, frequency up conversion, filtering, amplification andtransmission to the communication network 719 (or networks) via theantenna 718. Although a single transceiver 711 is shown in FIG. 9 forboth voice and data communications, it is possible that the dual-modemobile communication device 710 may include two distinct transceivers, afirst transceiver for transmitting and receiving voice signals, and asecond transceiver for transmitting and receiving data signals.

In addition to processing the communication signals, the DSP 720 alsoprovides for receiver and transmitter control. For example, the gainlevels applied to communication signals in the receiver 712 andtransmitter 714 may be adaptively controlled through automatic gaincontrol algorithms implemented in the DSP 720. Other transceiver controlalgorithms could also be implemented in the DSP 720 in order to providemore sophisticated control of the transceiver 711.

The microprocessor 738 preferably manages and controls the overalloperation of the dual-mode mobile communication device 710. Many typesof microprocessors or microcontrollers could be used here, or,alternatively, a single DSP 720 could be used to carry out the functionsof the microprocessor 738. Low-level communication functions, includingat least data and voice communications, are performed through the DSP720 in the transceiver 711. Other, high-level communicationapplications, such as a voice communication application 724A, and a datacommunication application 724B may be stored in the Flash memory 724 forexecution by the microprocessor 738. For example, the voicecommunication module 724A may provide a high-level user interfaceoperable to transmit and receive voice calls between the dual-modemobile communication device 710 and a plurality of other voice devicesvia the network 719. Similarly, the data communication module 724B mayprovide a high-level user interface operable for sending and receivingdata, such as e-mail messages, files, organizer information, short textmessages, etc., between the dual-mode mobile communication device 710and a plurality of other data devices via the network 719. In thedual-mode mobile communication device 710, a component framework 206 asdescribed above may also be implemented as a software module orapplication, or incorporated into one of the software modules 724A-724N.

The microprocessor 738 also interacts with other dual-mode mobilecommunication device subsystems, such as the display 722, Flash memory724, random access memory (RAM) 726, auxiliary input/output (I/O)subsystems 728, serial port 730, keyboard 732, speaker 734, microphone736, a short-range communications subsystem 740 and any other dual-modemobile communication device subsystems generally designated as 742.

Some of the subsystems shown in FIG. 9 perform communication-relatedfunctions, whereas other subsystems may provide resident or on-devicefunctions. Notably, some subsystems, such as keyboard 732 and display722 may be used for both communication-related functions, such asentering a text message for transmission over a data communicationnetwork, and device-resident functions such as a calculator or task listor other PDA type functions.

Operating system software used by the microprocessor 738 is preferablystored in a persistent store such as Flash memory 724. In addition tothe operating system, which controls all of the low-level functions ofthe dual-mode mobile communication device 710, the Flash memory 724 mayinclude a plurality of high-level software application programs, ormodules, such as a voice communication module 724A, a data communicationmodule 724B, an organizer module (not shown), or any other type ofsoftware module 724N. The Flash memory 724 also may include a filesystem for storing data. These modules are executed by themicroprocessor 738 and provide a high-level interface between a user ofthe dual-mode mobile communication device and the mobile device. Thisinterface typically includes a graphical component provided through thedisplay 722, and an input/output component provided through theauxiliary I/O 728, keyboard 732, speaker 734, and microphone 736. Theoperating system, specific dual-mode mobile communication devicesoftware applications or modules, or parts thereof, may be temporarilyloaded into a volatile store, such as RAM 726 for faster operation.Moreover, received communication signals may also be temporarily storedto RAM 726, before permanently writing them to a file system located inthe persistent store 724.

An exemplary application module 724N that may be loaded onto thedual-mode mobile communication device 710 is a personal informationmanager (PIM) application providing PDA functionality, such as calendarevents, appointments, and task items. This module 724N may also interactwith the voice communication module 724A for managing phone calls, voicemails, etc., and may also interact with the data communication modulefor managing e-mail communications and other data transmissions.Alternatively, all of the functionality of the voice communicationmodule 724A and the data communication module 724B may be integratedinto the PIM module.

The Flash memory 724 preferably provides a file system to facilitatestorage of PIM data items on the dual-mode mobile communication device710. The PIM application preferably includes the ability to send andreceive data items, either by itself, or in conjunction with the voiceand data communication modules 724A, 724B, via the wireless network 719.The PIM data items are preferably seamlessly integrated, synchronizedand updated, via the wireless network 719, with a corresponding set ofdata items stored or associated with a host computer system, therebycreating a mirrored system for data items associated with a particularuser.

The dual-mode mobile communication device 710 may also be manuallysynchronized with a host system by placing the dual-mode mobilecommunication device 710 in an interface cradle, which couples theserial port 730 of the dual-mode mobile communication device 710 to theserial port of the host system. The serial port 730 may also be used toenable a user to set preferences through an external device or softwareapplication, or to download other application modules 724N forinstallation. This wired download path may be used to load an encryptionkey onto the dual-mode mobile communication device 710, which is a moresecure method than exchanging encryption information via the wirelessnetwork 719.

Additional application modules 724N may be loaded onto the dual-modemobile communication device 710 through the network 719, through anauxiliary I/O subsystem 728, through the serial port 730, through theshort-range communications subsystem 740, or through any other suitablesubsystem 742, and installed by a user in the Flash memory 724 or RAM726. Such flexibility in application installation increases thefunctionality of the dual-mode mobile communication device 710 and mayprovide enhanced on-device functions, communication-related functions,or both. For example, secure communication applications may enableelectronic commerce functions and other such financial transactions tobe performed using the dual-mode mobile communication device 710.

When the dual-mode device 710 is operating in a data communication mode,a received signal, such as a text message or a web page download, willbe processed by the transceiver 711 and provided to the microprocessor738, which will preferably further process the received signal foroutput to the display 722, or, alternatively, to an auxiliary I/O device728. A user of the dual-mode mobile communication device 710 may alsocompose data items, such as email IM and SMS messages, using thekeyboard 732, which is preferably a complete alphanumeric keyboard laidout in the QWERTY style, although other styles of complete alphanumerickeyboards such as the known DVORAK style may also be used. User input tothe dual-mode mobile communication device 710 is further enhanced with aplurality of auxiliary I/O devices 728, which may include a thumbwheelinput device, a touchpad, a variety of switches, a rocker input switch,etc. The composed data items input by the user may then be transmittedover the communication network 719 via the transceiver 711.

When the dual-mode mobile communication device 710 is operating in avoice communication mode, the overall operation of the dual-mode mobilecommunication device 710 is substantially similar to the data mode,except that received signals are preferably be output to the speaker 734and voice signals for transmission are generated by a microphone 736.Alternative voice or audio I/O subsystems, such as a voice messagerecording subsystem, may also be implemented on the dual-mode mobilecommunication device 710. Although voice or audio signal output ispreferably accomplished primarily through the speaker 734, the display722 may also be used to provide an indication of the identity of acalling party, the duration of a voice call, or other voice call relatedinformation. For example, the microprocessor 738, in conjunction withthe voice communication module and the operating system software, maydetect the caller identification information of an incoming voice calland display it on the display 722.

A short-range communications subsystem 740 is also included in thedual-mode mobile communication device 710. For example, the short-rangecommunications subsystem 740 may include an infrared device andassociated circuits and components, or a short-range wirelesscommunication module such as a Bluetooth™ module or an 802.11 module toprovide for communication with similarly-enabled systems and devices.Those skilled in the art will appreciate that “Bluetooth” and 802.11refer to sets of specifications, available from the Institute ofElectrical and Electronics Engineers (IEEE), relating to wirelesspersonal area networks and wireless LANs, respectively.

The above description relates to one or more exemplary systems andmethods. Many variations will be apparent to those knowledgeable in thefield, and such variations are within the spirit and scope of theinvention as outlined in the claims appended hereto.

1. A wireless device comprising: a first input event component executinga first input event and a second input event; a user interfacedisplaying a symbol table in response to the first input event, thesymbol table including a plurality of individual symbol selections; theuser interface displaying an object table in response to the secondinput event, the object table comprising a plurality of graphic objectsand a plurality of predefined inputs, each of the plurality ofpredefined inputs associated with each of the plurality of graphicobjects; and a second input event component executing a third inputevent, the third input event mapped to one of the plurality ofpredefined inputs; wherein the third input event selects a graphicobject associated with the predefined input from the plurality ofgraphic objects and inserts the selected graphic object in a text basedmessage.
 2. The wireless device of claim 1, wherein the plurality ofgraphic objects is selected from the group consisting of: emoticons;abbreviated text strings; icons; predefined groups of alphanumericcharacters and a combination thereof.
 3. The wireless device of claim 2,wherein the alphanumeric characters are selected from the groupconsisting of ASCII characters, Unicode characters, and a combinationthereof.
 4. The wireless device of claim 1 wherein the first input eventcomponent is an input key of a keyboard of the user interface.
 5. Thewireless device of claim 1, wherein the third input event is executedthrough a voice command of the user interface.
 6. The wireless device ofclaim 1, wherein the first and second input event components aredifferent input keys of a keyboard.
 7. The wireless device of claim 1,wherein the symbol table is a first symbol table of plurality of symboltables and wherein the first input event comprises a series of eventscausing each of the plurality of symbol tables to be displayed.
 8. Amethod for selecting graphic objects to insert in a text based messagewhen composed on a wireless device, the method comprising: executing afirst input event using a first input component to enter a first mode,wherein in the first mode a symbol table is displayed on a userinterface of the wireless device, the symbol table including a pluralityof individual symbol selections; executing a second input event usingthe first input component to enter a second mode, wherein in the secondmode an object table is displayed on the user interface of the wirelessdevice, the object table comprising a plurality of graphic objects and aplurality of predefined inputs, each of the plurality of predefinedinputs associated with one of the plurality of the graphic objects;executing a third input event using a second input event component, thethird input event mapped to one of the plurality of predefined inputs,the third input event selecting a graphic object associated with thepredefined input from the plurality of graphic objects and inserting theselected graphic object in the text based message.
 9. The method ofclaim 8, wherein the plurality of graphic objects is selected from thegroup consisting of: emoticons; abbreviated text strings; icons;predefined groups of alphanumeric characters, and a combination thereof.10. The method of claim 9, wherein the alphanumeric characters areselected from the group consisting of ASCII characters and Unicodecharacters, and a combination thereof.
 11. The method of claim 9,wherein the first input event is executed through an input key of akeyboard of the user interface.
 12. The method of claim 9, wherein thethird input event is executed through a voice command of the userinterface.
 13. The method of claim 12, wherein the voice command isdisplayed in the object table.
 14. The method of claim 8, wherein themessage is configured for sending to a remote message server.
 15. Themethod of claim 14, further comprising translating the selected graphicobject in the message to an equivalent string of the individualalphanumeric characters represented by the selected graphic object. 16.The method of claim 14, further comprising transmitting the message to aserver selected from the group consisting of: an email server; aninstant messaging server; and a short message service server.